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I. INT80DOCTION 



Ihe purpose of this thesis was to investigate various 
factors affecting the academic performance of Naval Officer 
students in the Operations Analysis Curriculum at the Naval 
Postgraduate School. Ihe original goal was to arrive at a 
predictive model which would improve the present selection 
process and possibly reduce the numbers of student academic 
transfers out of the Operations Analysis Curriculum. These 
transfers have historically been about 10% of the original 
class. Due to the relatively small sample size (159) , it 
was not possible to cross validate . Because of this the 
results are not presented as a predictive model. The 
utility of the study is rather in its analysis of those 
factors influencing the student's academic performance; the 
resultant promotion of understanding, and suggestions for 
further study of the subject. 

The pertinent variables that were readily available and 
are in this study are college QPR, college degree, the 
Officer's designator, college guality rating, elapsed time 
from completion of college to starting the Operations 
Analysis curriculum, year graduated from the OA Curriculum, 
and the length of refresher attended at the Naval 
Postgraduate School. Current practice using only the "APC” 
codes as a predictor achieves a multiple correlation coeffi- 
cient of .21 when run through the ANOVA package. The model 
recommended in the study has an of .41 while another 

model achieves an R^ as high as .53. 

Ihe study subjects include approximately one-half of the 
Navy OA graduates from the period 1974 to 1985. This was 
the case since APC's were only available for about one-half 
of the graduates. The study incluaes only those students 
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wita academic profile codes of 435 or better. The recom- 
meaded APC for the Operations Analysis Curriculum is 324 or 
better. There were 43 individuals included in the study 
whose APC was ,at least in one of the three digits, outside 
that recommended for OA. Cf these 43 people, 6 went 
straight into the curriculum without any refresher. 

A review of the literature reveals a thesis written by 
Heru Soetrisno in 1975 titled "Prediction of Academic 
Performance of the 0. S. Navy Officer Students in the 
Operations hesearch/Systems Analysis curriculum at the Naval 
Postgraduate School" [fief. 1 ]. The study was a regression 
analysis using biographical data, a personal interest survey 
and the graduate record examination. It covered ail the 
Navy students in OA in the Spring of 1974 (72 students) . 

The thesis concluded that the three above mentioned vari- 
ables and combinations of them were better predictors of 
student performance than undergraduate QPE and college 
quality. 

Numerous articles have also 
subject of predicting academic 
many of these articles has left 
sion that it is clearly not a 
test or measure is the best in predicting academic perform- 
ance. However of all the choices, it is recognized that 
prior academic performance and aptitude tests are generally 
considered to the most important predictors of future 
academic performance [fief. 2: page 10]. 

The study opens with the development of the academic 
profile code and a review of the data. The analysis is 

conducted by first a preliminary look at the independent 
variables in relationship to the dependent variable and then 
with an analysis of variance technique. The study ends with 
several conclusions and recommendations for future 
consideration. 



been written concerning the 
performance. A review of 
the author with the impres- 
clean-cut issue as to what 



II- BACKGRO OND 



The Navy Military Personnel Command (NMPC) is respon- 
sible for filling quotas at the Naval Posgraduate School. 
The current procedure is to convene annually a Graduate 
Selection Board £Re£. 3]. This board meets and reviews 
those Officer’s records who are potentially eligible for 
graduate education as shown in enclosure four of [ Bef . 3]- 
The beard bases their determination for possible graduate 
education on the Officer’s professional performance and 
their academic ability as evidenced by their academic 
profile code (APC) [Bef. 4], The most recent board screened 
13,000 records and selected 4,000 for possible graduate 
studies- Approximately 90% of those students eventually 
completing fully funded graduate studies will receive their 
degrees from the Naval Postgraduate School [Bef. 5: page 

25]. 



T 

edu ca 
Fig ur 
A 

sheet 
Naval 
for e 
is f 
off ic 
until 
has 
NMPC 
remov 
Off ic 



he APC is a three digit code summarizing the previous 
tion of each Officer and is calculated as seen in 
e 2.1 . 

ppendix B is a sample academic record evaluation (ARE) 
, The ARE is used by the director of admissions at the 
postgraduate school as a worksheet to compute an APC 
very newly designated Naval Officer each year. The ARE 
iled and maintained at the Director of Admission’s 
e at the Naval Postgraduate School and is kept on file 
the Officer has been designated as a subspecialist or 
teen determined not suitable for graduate education. 

annually directs the Naval Postgraduate School to 
€ and destroy the AHE’s for those above mentioned 
er s. 
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OPR CODE 
(1st ARC Digit) 






(Code 1 


Grade 


1 

1 

o 


Range 


Code f 


I ° 


A-/A 


3.60 


- 4.00 


0 


1 1 


B* 


3.20 


- 3.59 




2 


B-/8 


2.60 


- 3.19 




3 


C+ 


2.20 


- 2.59 


1 


4 


C 


1.90 


- 2.19 




5 


Below C 


0.00 


- 1.89 


2 


Repeated" courses 


and failures 





are included in the QPK calcu- 
lation.) 3 



4 

ft 



MATH cnnE 

( ?n<i A PC n jn 1 1 ) 

Ca Icul us-Rp I ateH ^ath Cowrsps 

Sianificant Dost-calculus math with 
B average 

Two or more calculus courses with 
average 

Two or more calculus courses with 
C+ average 

One calculus course with 
C grade or better 

Two or more ore-calculus courses with 
B average or better 

At least one ore-calculus course with 
C grade 

No college-level math with C grade 



C ode I 
0 
1 
2 



TECHNICAL CflDE 
(3rd ARC Digit) 



Physics (Calculus-Based) 



Complete sequence taken with 
B+ average 

Complete sequence taken with 
C* average 

At least one course with 
C grade 



Significant Uooer-Di vision Course 
Coverage in a Pertinent Engineering 
or Physical Science riiscioline 



B> average 
C* average 



None 



Figure 2.1 Calculating APC*s. 
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The APC is originally based on the individual's college 
perfornance and rarely changes unless the individual corre- 
sponds with the Director of Admissions at tne Kaval 
postgraduate School and petitions to raise (improve) his APC 
with written proof of additional accredited academic 
achievement [Be£. 4; page 11]- 

A Naval Officer must possess an APC of 324 or better 
(e. g. 112) to directly enter the Operations Analysis 

Curriculum [Ref. 5: page 32]. Additionally, a Naval Officer 
may enter the OA Curriculum with an APC of 344 after 
completing one or twc guarters of the Engineering Science 
Curriculum. The Engineering Science Curriculum is designed 
to provide an opportunity for Officers with inadequate math- 
ematical and physical science backgrounds to establish a 
good math foundation to be able to qualify for a technical 
curriculum [Ref. 5: page 36]. There is also a six week 

refresher available that is designed to rapidly cover the 
calculus and physics fundamentals for those Officers who are 
direct inputs into the OA curriculum without any quarters of 



Engineering 


Science. 


Exceptions 


are 


made 


and it 


is 


possible 


for an 


individual t 


o en 


ter 


the 


OA 


curriculum 


without the 


minim urn 


APC. 


It is 


also 


possible 


for 


an 


Officer 


to 


start OA 


wit h out 


any 


ref res 


her 


at 


all 


as 


did 


63 of 


the study 


sub jects 






















T be 


OA curriculu 


m is 


of 


a techni 


cal 


nature 


and 


students 



with solid college performance and technical majors are 
encouraged to enroll in it. However, there are some very 
good professional Officers who do not have the required 
academic background to directly enroll in OA- The Navy 
would like some of these Officers to be able co attend NPS 
in a technical curriculum . In response to this need, the 
Navy has recently introduced ( 1985) the Technical Transition 
Program (TTP) . This program is designed to allow those 
pro f ess ionally exceptional Officers with weak college 



1 4 



backgrounds to enter a technical curriculum via a one or two 
quarter individually tailored preparation program. This 
program is slightly different from the Engineering Science 
curriculum in that it is individually structured to meet 
each student's needs while it also varies from different 
curriculum to curriculum. This program not only provides an 
opportunity to Officers that at one time had no or little 
hope cf attending the Naval Postgraduate School but it also 
provides more graduate trained subspecialists for the Navy- 
The college records of these candidates for the TTP are 
screened at the Naval Postgraduate School and a decision is 
made whether or not to allow an individual to start the 
program in hopes of eventually entering a technical curric- 
ulum. This study reveals several important factors and 
considerations in order to help the decision maker better 
access the potential academic performance of future OA 
students. 



the 



Ill- DISCOSSION OP THE DAT A 



The study data was gathered from several sources 
including the Office of the Registrar, Director of 
Admissions, the Operations Analysis Curricular office at the 
Naval Postgraduate School and from the Naval Military 
Personnel Command. Most of the data was obtained from the 
individual student files maintained by the Operations 
Analysis curriculum secretary. These files contained much 
of the student data such as University attended and what 
dates attended, college degree, designator and length of 
refresher attended at the Naval Postgraduate school. These 
same files contain the student's grade sheet summary of all 
course work completed at the Naval Postgradute School. From 
this sheet, the dependent variable in the study was calcu- 
lated. Four different quality point ratings (QPfi) were 
studied. The first was the student's total grade average 
after four quarters of the Operations Analysis Curriculum. 
This grade is of special importance as it is at this point 
in the curriculum that a final decision must be made as to 
continue a marginally performing student in nopes that his 
overall grade point average will improve or to allow him to 
possibly transfer to another curriculum with enough time 
remaining to successfully complete that program. It is also 
important to note that through the first four quarters each 
option is essentially the same. Hence, there is uniformity 
in the program- If a model could be constructed that would 
improve the present selection process and reduce the numbers 
of these transfers, a savings in time and money could be 
realized by the Navy. 

The three other dependent variables looked at were the 
student's quality point rating after six quarters (when most 
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of the stringent course requirements are finished), his 
graduate gpr after eight quarters and also the total overall 
quality point rating after eight quarters which completes 
the degree. All these qpr* s were determined by dividing the 
weighted total of the grade points earned by the total hours 
attempted for the respective quarter totals. None of these 
qpr*s included any grades earned during refresher courses. 

Ihe academic profile codes were the most difficult data 
points to obtain. Although the Director of Admissions main- 
tains a computer printout of all current APC's, very few of 
tne study subjects were still on the listing. Of the 343 
Navy CA students completing the Operations Analysis curric- 
ulum at the Naval Postgraduate School from 1974 to 1985, 
only 80 of them had APC’s in the printout, in their files or 
in their academic record evaluation sheets. The additional 
APC’s were obtained from the Officer’s data card sent to the 
Naval Postgraduate School by NMPC. A total of 172 APC’s 
were obtained. Of these 172 APC’s, 159 were used in the 
study. The thirteen individuals removed from the study were 
in very low populated levels of several of the variables. 
The variables for the academic profile codes are seen in 
Figure 3.1 . 

The 159 Naval Officer study subjects all graduated with 
Master Degrees in Operations Analysis. Although not a 
random sample, they were treated as a random sample for the 
purpose of the study. There was no apparent grouping or 
special distribution of the study subjects compared to the 
entire population of 343. The data were tabulated into an 
159 by 18 matrix and is included as Appendix C. 

The variable college rating was obtained from the 
Gourman Report [Bef, 6: page 7]. This report evaluated 
1,845 colleges and universities in terms of the institu- 
tion’s objectives, curriculum, faculty, faculty research and 
honors, administration, library, budget, resources, student 
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APC3 = Technical Code 
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19 
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25 
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59 
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39 
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Figure 3. 1 APC Main Effects. 

scores on standardized tests, admission policy, and several 
other tactors. Toe range for the college rating variable as 



a 


cofactor was 


4.99 for the 


highest 


rated institution 


down 


to 


a rating of 2 


.01 for the 


lo west. 


This variable was 


also 


looked at as a 


possible main effect 


and w as 


divided 


into 


categories as seen in Figure 


3.2 . 
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range 
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# of 


data points 




s t rong 


4.41-4.99 


6 




34 






good 


4.01-4.40 


5 




85 






acceptable 


3.51-3.99 
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18 






adequate 


3.01-3.50 
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19 
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marginal 


2.01-2.99 


2 




3 
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total 


159 
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Figure 3.2 


College 


Bating. 








The varaable 


college degree is seen in Figu 


re 3.3 . 


The 


grouping Naval 


Science was required due to 


the twelve 



students included in the study who graduated from the Naval 
Academy prior to 1973. Prior to that time only one aegree 
was ccnxirmed by the institution and although the midshipmen 
took a variety of courses, many of wnich were of an tngi- 
neering nature, they received a B.S. degree in Naval 
Science. 

Ihe variable refresher was investigated as botn a main 
effect (yes=attended cr no=did not attend) and as a cofactor 
listing the length, in quarters, of refresher taken at the 
Naval Postgraduate School. There is a six week reiresher 
for each class prior to starting the curriculum. 
Additionally, a student may possibly receive one or two 
quarters of refresher depending on several factors. These 
quarters of refresner are generally undertaken by students 
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1 



Degree 



level 



# of data points 



Business 

Engineering 

Humanities 

Math 

Social Science 
Naval Science 
Operations Analysis 



1 

2 

3 

4 

5 

6 
7 



14 

31 

4 

59 

16 

12 

23 



total 



159 



Figure 3.3 College Degree. 

not neeting the minimum recommended APC for OA or for 
students who have not been in an academic environment for a 
long period of time. The decision is generally made at the 
Curricular Officer and Academic Associate's concurrence and 
with approval from the student's detail er. There is nothing 
concrete aoout this process and it is possible to start the 
curriculum directly without any refresher. The cofactor 
length of refresher was grouped as seen in Figure 3.4 . 

The variable designator was viewed as a main effect. 
Each Naval Officer has one designator which is generally 
assigned after completing a school or training course. They 
retain this designator for their entire length of service 
with the few exceptions of individuals transfering to 
another specialty and hence changing designators. The 
designators of the study group can be seen in Figure 3. 5 . 

Table I is a summary listing of all tne variables and 
their levels that were investigated in the study. 
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engineering duty 
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intelligence 
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Figare 3.5 Designator. 



TABLE 1 

EXPLABATIOH OP TBB STODI’S VARIABLES 



Cofactors 



Values 



time since college in months 
college rating 
year graduated from NPS 
length of refresher (quarters) 
Main, Effects 



23-178 

2.01-4.99 

74-85 

0, .5, 1, 2 
Level 



APCl college qpr * 
APC2 math code •' 

APC3 technical code * 

College Degree 



1 . 2 , 3 , 4, 5 
1 , 2 , 3, 4 
1 , 2 , 3 , 4 , 5, 6 
Level 



Business 1 

Engineering 2 

Humanities 3 

Natural Science (Math) 4 

Social Science 5 

Naval Science 6 

Operations Analysis 7 

Designator Level 



IlOx 


Restricted line 


1 


lllx 


Unrestricted line 


2 


112x 


Submarines 


3 


131x 


Aviator 


4 


132x 


Naval flight officer 


5 


140x 


Engineering Duty officer 


6 


161x 


Intelligence officer 


7 


310x 


Supply officer 


8 


113x 


Special Warfare officer 


9 



“ Coded as APC + 1 for computer indexing 
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IV. PftELIflIHAM ALTS IS OF THE DATA 



A prelimiaary analysis of the data was conducted using 
APL and Grafstat capabilities of the IBM 370 located at the 
Naval Postgraduate School. Each variable was investigated 
in relation to tne dependent variable "4th quartet gpr". 
All remarks of significant differences are a result of a 
formal "t" test with a .05 level of significance. 



A. 4TH QUAhTEB QPB VERSOS APC1 

The first APC digit representing the individual's 

overall college gpr was plotted against his academic 

performance in the OA curriculum through the fourth quarter. 
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Figure 4.1 4th QTB QPR vs APCI. 



23 




Figure 4.1 is a graphical representation of the statistical 
relationsnip while the results are tabulated in Table II, 



TABLE II 

4th QTB QPB fS APC1 



CATBG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


0 


8 


0.050314 


3.72 


0.24068 


3.43 


3.63 


3.96 


1 


28 


0.1761 


3.5386 


0.27132 


3.36 


3.47 


3.75 


2 


79 


0.49686 


3.3448 


0.3088 


3.09 


3.34 


3.59 


3 


39 


0.24528 


3.2826 


0.32053 


3.07 


3.25 


3.46 


4 


5 


0.031447 


3.042 


0.34672 


3.02 


3.11 


3.15 



These results show the student's performance in college has 
a direct and logical relationship to his performance through 
the fcurth quarter of the OA curriculum. The higher one's 
college qpr tne better one's performance in OA- The study 
group's average APC for the first digit is very close to two 
while the overall grand mean for their fourth quarter grade 
was 2.37. The highest code of zero had a significant 
difference compared to the overall mean. 

B. 4TH QUARTEB QPB VEBSOS APC2 

The second APC digit representing the student's under- 
graduate calculus proficiency was plotted against his 4th 
quarter qpr. Figure 4.2 is a representation of this rela- 
tionship and the numerical results ace tabulated in Table 
III. There is a significant difference among the first two 
levels of this variable and the overall mean. The recom- 
mended APC for OA in math is three or better while four is 
acceptable via the engineering science curriculum. The 
study group's average was 1.7 while the entire group had a 
math APC of three or better. Tne overall relationsnip is 
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just a sligot positive one where the lower (better) one’s 
math code translates to a higher 4th guarter grade. 

C. 41H QUABTEB QPR fEBSOS APC3 
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Figure 4.2 



4th QTB QPB VS APC2. 



The thira APC digit representing the studen 
code was similary studied and is shown Figure 
IV. This relationship does not show a iogica 
of high 4th guarter performance with the bet 
codes. It in fact jumps back and forth with 
logic. Admission to the CA curriculum may 
compensating feature. 

The last level (those students with an 
five) of thirteen individuals had the second 
gpr. Tnese thirteen subjects were looked at in 



t’s technical 
4.3 and Table 
1 progression 
ter technical 
no apparent 
reflect some 

APC3 code of 
best average 
dividually to 
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TABLE III 

4TH QTR QPB ?S APC2 



CATBG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


0 


24 


0.15094 


3.4963 


0.26836 


3.29 


3.43 


3.75 


1 


29 


0.18239 


3.5034 


0.2918 


3.29 


3.59 


3.7 


2 


76 


0.47799 


3.3143 


0.32307 


3.08 


3.3 


3.49 


3 


30 


0.18868 


3.297 


0.3607 


3.03 


3.22 


3.58 
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Figure 4.3 4th CTB QPR VS APC3. 

cry to determine a possible reason for this. It was discov- 
ered, that as a group, their average first digit APC for 
tneir college performance was 1.4. This is much tetter than 
the entire study group’s average of 2.1. The only differ- 
ences between the six level means and the overall mean that 
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TABLE 17 

4TH QTB QPfi 7S APC3 



CATBG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


0 


4 


0.025157 


3.705 


0.17642 


3.5 


3.59 


3.77 


1 


19 


0.1195 


3.4511 


0.33468 


3.05 


3.46 


3.79 


2 


25 


0.15723 


3.3636 


0.29094 


3.1 


3.29 


3.6 


3 


59 


0.37107 


3.3958 


0.29821 


3.16 


3.36 


3.63 


4 


39 


0.24528 


3.2379 


0.3671 


3.96 


3.26 


3.46 


5 


13 


0.081761 


3.4769 


0.27921 


3.29 


3.46 


3.73 



were statistically significant were the first level zero and 
the next to last level four. 

O. 4IH QUABTEB QPR 7EBS0S COLLEGE DE6BEE 

College degree was the next variable plotted against the 
4th quarter qpr. Figure 4.4 graphically presents and Table 
V lists this data. 

Although none of the differences are statistically 
significant, the business, engineering, math and operations 
analysis majors performed above the mean of the study 

sample. If one disregards an outlier or two within the OA 

level, OA would have shown a greater positive difference 
from the grand mean and this can be seen in its inter- 
quartile range. The data shows an intuitively logical 

assumption that students with a social science or humanities 
undergraduate degree would do less well in a technical 
curriculum when compared to students with a more quantita- 
tive college degree such as engineering or mathematics. The 
performance of those people with naval science majors is 
relatively low. This may be a result of several confounding 
factors not readily apparent. 
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figure 4-4 4th QTB QPR fS College Degree. 



TABLE T 

4TH QTB QPfi VS COLLEGE DEGBEE 



CATBG. NO. 


PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


BUSINESS 


14 


0.08805 


3.4657 


0.30352 


3.31 


3.43 


3.61 


ENGINEERING 


31 


0.19497 


3.4274 


0.32373 


3.11 


3.41 


3.77 


HUMANITIES 


4 


0.025157 


3.2475 


0.3447 


2.93 


3.11 


3.12 


MATH 


59 


0.37107 


3.4037 


0.31953 


3.17 


3.37 


3.69 


SOCIAL SCI 


16 


0.10063 


3.2306 


0.32225 


3 


3.16 


3.43 


NAVAL SCI 


12 


0.075472 


3.1875 


0.28902 


2.99 


3.11 


3.3 


OA 


23 


0.14465 


3.3822 


0.33327 


3.26 


3.42 


3.53 



E. 4TH CUABTEB QPB VEBSOS DESIGNATOR 

The student's designator was the next variable plotted 
against 4th quarter qpr. Disregarding the very small levels 
of 1400, 1610, and 1130 from the discussion, leaves only 
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1120 (submariners), 1320 (naval flight officars) and 3100 
(supply) designators that did better than the grand mean. 
This can be seen in Figure 4.5 and Table VI. A test of 
significance showed only the 1120 and 3100 designators 
performed better and the 1100 designator performed worse 
than the overall mean. 
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Figure 4.5 uth QTE QPR FS Designator. 



F. 4TH QUAETEfi QPB FEESOS LEN6TB OF REFEESHER 

The variable length of refresner was plotted against 4th 
quarter gpr as seen in Figure 4.6 and Table Vll. 

It can be seen that those individuals who do not attend 
refresher do slightly better than tne students that attend 
refresher. This could mean that a good job is done identi- 
fying those individuals who need refresher. It is also 
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TABLE ?I 

4TH CTH QPE fS DESIGHATOfi 



CATEG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


1100 


6 


0.037736 


3.3517 


0.30954 


3.07 


3.34 


3.63 


1110 


50 


0.31447 


3.2456 


0.31481 


3.04 


3.19 


3.43 


1120 


10 


0.062893 


3.654 


0.32855 


3.35 


3.82 


3.96 


1310 


41 


0.25786 


3.341 


0.23245 


3.15 


3.37 


3.47 


1320 


26 


0.16352 


3.4588 


0.31471 


3.26 


3.46 


3.75 


1400 


1 


0.0062893 


3.29 


0 


3.29 


3.29 


3.29 


1610 


3 


0.018868 


3.4533 


0.31753 


3.1 


3.39 


3.87 


3100. 


20 


0.12579 


3.553 


0.35289 


3.25 


3.69 


3.83 


1130 


2 


0.012579 


2.88 


0.26 


2.62 


2.62 


3.14 
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Figure 4.6 4th QTB QPB VS Length of Befresher. 



possible that the students tnemselves nave an influence in 
wnether or not they attend refresner. It could also be that 
those students that have a very confident opinion of their 
academic background may be deliberately deciding not to 
report until well after refresher starts. This sort of 
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TABLE ¥11 

4IH QTB QPE TS LENGTH OF BEPHESHER 



CATBG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


0 


63 


0.39623 


3.441 


0.33443 


3.15 


3.42 


3.77 


0.5 


58 


0.36478 


3.3597 


0.32014 


3.11 


3.32 


3.6 


1 


8 


0.050314 


3.54 


0.29039 


3.17 


3.43 


3.73 


2 


30 


0.18868 


3.2117 


0.28024 


3.03 


3.15 


3.43 



tidsed selection could be affecting the results of this 
variable. The result of the students with one quarter of 
refresher doing better than the mean could also be artifi- 
cial. Once they demonstrated that even though they fit the 
category of individuals who should get refresher, they 
really could handle the pace without it then they could be 
set hack into their original class with a few scheduling 
arrangements made. There is also no permanent incentive to 
do well in the 460 curriculum since the grades do not count 
and are not reflected in the student's total grade average. 
The formal test of significance showed that oniy the 
students with two quarters of refresher performed at a 
statistically lower level than the overall grand mean. 

G. 4TH COABTER QPfi VERSOS COLLEGE BATING 

The variable college rating was the next variable 
plotted against 4th quarter gpr and is shown in figure 4.7 
and Table VIII. The data does not show a significant 
difference among any of the college ratings. Disregard the 
lowest rating as it only contains three individuals. The 
remaining four categories shew a slight decrease in 4th 
quarter qpr as the rating decreases but it is not statisti- 
cally significant. 
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Figure 4-7 4th Qtr QPH ?S College Rating. 



j 



TABLE ?III 

4TH QUARTER QPR ¥ERSDS COLLEGE RATIMG 



CATBG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


2.0-2.99 


3 


0.018868 


3.3967 


0.26081 


3.16 


3.27 


3.76 


3. 0-3. 5 


19 


0.1195 


3.4005 


0.29915 


3.07 


3.43 


3.69 


3.5-3.99 


18 


0.11321 


3.3 


0.28746 


3.12 


3.28 


3.43 


4. 0-4. 4 


85 


0.53459 


3.3554 


0.32538 


3.11 


3.35 


3.56 


4.41-4.99 


34 


0.21384 


3.4382 


0.36992 


3.12 


3.4 


3.81 



H. 4TH QUARTER QPR VERSOS YEAR GRADUATED FROM NPS 

The variable year graduated from NPS was plotted against 
4th quarter qpr and is seen in Figure 4.8 and Table IX. The 
data is seen to be heavily concentrated in the three most 
recent years (46% of all study subjects). The years 74 and 
75 showed a statistically significant mean that was oelow 
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the overall mean of 3.37. The year 1980 was the only year 
that was significantly above the overall average. This 
could possibly reflect the "luck of the draw" as different 
student sections progress through the curriculum with 
dxfferent combinations of professors and grading practices. 
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Figure 4.8 4th QPB XS lear Graduated from NPS. 



1. 4TH COAETEB QPfi fEBSOS TIME SINCE COLLEGE 

The variable time since college was plotted against the 
4th quarter qpr as seen in Figure 4.9 and Table X. 

After discarding the first level with only two observations, 
it is of interest to note the very slight improvement in qpr 
as time since college increases. Once again the differences 
between the overall mean and the individual level means are 
not significant in a formal test of significance. The 
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TABLE IX 

4IH QUAETEfi QPfi 7EBS0S YEAR GRADUATED FROfl NFS 



CATEG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


1974 


8 


0.050314 


3.1388 


0.24174 


3.04 


3.11 


3.29 


1975 


12 


0.075472 


3.1825 


0.25898 


2.99 


3.09 


3.31 


1976 


7 


0.044025 


3.4314 


0.25525 


3.08 


3.5 


3.59 


1977 


7 


0.044025 


3.47 


0.21024 


3.22 


3.45 


3.67 


1978 


2 


0.012579 


3.515 


0.085 


3.43 


3.43 


3.6 


1979 


14 


0.08805 


3.3514 


0.33939 


3.03 


3.36 


3.53 


1980 


9 


0.056604 


3.6178 


0.21186 


3.58 


3.69 


3.76 


1981 


11 


0.069182 


3.2918 


0.28074 


3.1 


3.15 


3.48 


1982 


15 


0.09434 


3.4433 


0.39383 


3.27 


3.56 


3.76 


1983 


31 


0.19497 


3.3881 


0.355 


3.08 


3.39 


3.7 


1984 


27 


0.16981 


3.3441 


0.2765 


3.14 


3.32 


3.47 


1985 


16 


0.10063 


3.4381 


0.37902 


3.26 


3.43 


3.82 
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Figure 4-9 4th Quarter QEB ?s Time Since College- 

relative constant performance over tris variable is 
surprising as one would logically expect performance, to be 
degraded as the time since completing college and commencing 
another academic situation increases. 
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TABLE X 

4TH QOASTEfi QPH FEBSOS TIHE SINCE COLLEGE 



CATEG. 


NO.PTS 


%-PTS 


Y-MEAN 


Y-DVN 


.25 


.50 


.75 


ALL 


159 


1 


3.373 


0.33011 


3.12 


3.36 


3.64 


0-36 


2 


0.012579 


3.595 


0.165 


3.43 


3.43 


3.76 


37-60 


58 


0.36478 


3.3 


0.30956 


3.11 


3.29 


3.47 


61-84 


38 


0.23899 


3.4037 


0.34813 


3.11 


3.39 


3.67 


85-108 


27 


0.16981 


3.38 


0.35614 


3.1 


3.38 


3.64 


109-132 


19 


0.1195 


3.4516 


0.29108 


3.14 


3.48 


3.76 


133-185 


15 


0.09434 


3.436 


0.31117 


3.12 


3.34 


3.79 



The preceeding relationships were looked at to investi- 
gate the basic properties of the variables studied and not 
to draw conclusions on these results. It would be incorrect 
to draw the conclusion that tnese one to one coaparisons 
imply any direct cause and effect without studying the 
interactions of all the variables concerned. Chapter V will 
investigate these relationships with an analysis of variance 
approach. Appendix D contains the same figures and tables 
for the other three dependent variables (6tn quarter grad- 
uate qpr, 8th quarter graduate total gpr and 8th quarter 
total qpr) . 
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V. BESOLTS OF TBE ANALYSIS 



A. AFPfiOACH OF THE ANALYSIS 

This chapter describes the analysis techniques used and the 
results from the analysis. The analysis of the data was 
conducted with the aid of the Naval Postgraduate School's 
IBM 370 computer using an "ANOVA” package designed by 
Professor Bussell Richards of the Naval Postgraduate School. 

The "ANOVA" package is capable of performing multiple 
linear regression on unbalanced data. It is an APL program 
with many and varied outputs. Appendix E is an explanation 

of the "ANOVA" program, its capabilities and required input 
data format. The program uses the least squares approach 
and calculations are done in matrix format. 

All of the 159 students that comprised the population of 
this study were included in the analysis to develop a model 
for possible prediction of student performance. A cross 
validation procedure, using a portion of the data, would 
have teen a useful technique to check the validity of the 
results. This procedure was not employed due to the limited 
numoer of academic prefile codes tnat were available for the 
study . 

5. MULTIPLE LINEAfi BEGRESSION ANALYSIS 

Multiple linear regression techniques were employed 
using the "ANOVA" program to develop the explanatory vari- 
ables to be included in the model and then to estimate the 
coefficaents describing the weights to assign to the 
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variables. 
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The model used is of the matrix form: 

I = XB ♦€ fegn 5. 1) 



where. 


Y 


i s 


a 


vector 


of 


dependent variables 




X 


i s 


a 


matrix 


of 


independent variables 




B 


i s 


a 


vector 


of 


coefficients 




e 


i s 


a 


vector 


of 


error terms. 



Id ANOVA applications of linear models, the gualxtative 
(main and interaction) effects are estimated on an interval 
scale and have arbitrary origins. Hence the matrix X is 
singular. The "ANOVA” package (Professor Richards) solution 
manages this problem by deletion of selected columns and 
these selected columns are listed for the user. A selected 
column represents an omitted variable whose estimated coef- 
ficient is the negative of the total of all other variables 
in its category. 

D. AS5UHPTI0HS FOB LINEAR REGRESSION 

While using the linear regression approach, a number of 
assumptions must be made concerning the error terms. The 
errors must he independent, have zero mean, constant vari- 
ance and must be normally distributed [Ref. 7]. Each time 
the "ANOVA" program was run on a different version of the 
model the residuals were plotted to verify these assump- 
tions. Figure 5.1, Figure 5.2 and Figure 5.3 display these 
results for the particular model that will later be devel- 
oped as the study model of choice. These figures and the 
discussion in the following paragraph show the assumptions 
are adeguately met. 

The variables included in the model must also be inde- 
pendent, The Pearson's product moment correlation 
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NORMAL DENSITY FUNCTION. N=159 
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NORMAL CUMULATIVE DISTRIBUTION FUNCTION. N=159 




RESIDUALS FROM 4TH OTR MODEL 



Figure 5.1 Plots of Besiduals from the Study Model of Choice. 
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3.0000EO 
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0.48034 


4, 1804E‘I 


KS. AO. 


MO CV SICNIF. 


LEVELS NOT I 



C0VARIA>I:E UAfRlX OF 

parameter ESTUXATES 



MJ 


SIGMA 


L4J 0 00040351 0 


SIGMA 0 


0 00020303 


GOGONESS OF 


FIT 


CHI-SOUARE 


2.6393 


UO TREED 


5 


SIGnlF 


0.72474 


KOlU-CMIRN 


0.044G04 


SICNIF 


0.90979 


CHamER-V m 


0.021326 


SICMIF 


> .15 


a/jder-darl 


0.3338 


SfONlF 


> 15 



WITH ESNmaIEO parameters 



0.95 CaiFIDDCE INTERVALS 
parameter estimate lower ur>PER 

1.4a20e-U -0 030379 0.030379 

SIGMA 2.5400E-1 0.2289 0.28557 



Figure 5.2 Besidual Plot and Data :Study Model. 
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Figure 5.3 Scatter Plot of Residuals :Study Model. 

coefficier*t (r) was calculated for the entire data matrix. 
Table XI is the results of these calculations. Several of 
the variables were looked at as both main effects (qualita- 
tive) and, after a transformation of the data, as cofactors 
(quantitative). In these cases of correlation between two 
scales of the same variable, a high r will be calculated. 
In all other possible correlations, the r value is low 
enouqh to be able to assume independence between the vari- 
ables of the study. 

The serial autocorrelation statistic was used to verify 
that the error terms were independent. This statistic is 
provided by the output menu of the ”ANOVA" program. For the 
error terms to be considered independent, the serial 
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TABLE XI 

COfiBELAIlOH BETBEEH THE STOD7 VABIABLES 



Golumn/Row 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 



Title 

APCl 

APC2 

APC3 

4th Qtr Opr 

6th Qtr Opr 

8th Qtr Opr 

8th Qtr Total Qpr 

College Degree 

Designator 

Time Since College 

Refresher (Yes: or no) 

College Rating (Gourman scale) 
Year Graduated NFS 



02 


-.38 


-.36 


-.36 


-.39 


.10 


-.08 


.19 


-.16 


.21 


-.11 


25 


-.24 


-.18 


-.18 


-.22 


-.09 


-.11 


.16 


-.17 


.16 


.19 




-.15 


-.14 


-.15 


-.16 


.07 


.06 


.02 


-.18 


-.21 


.23 




1 


.91 


.91 


.96 


-.14 


.21 


.12 


.17 


.06 


.13 






1 


.97 


.95 


-.11 


.19 


.11 


.20 


.08 


.18 








1 


.98 


-.11 


.23 


.11 


.21 


.09 


.16 










1 


-.12 


.23 


.11 


.18 


.09 


.16 












1 


-.11 


-.10 


.03 


.00 


.03 














1 


.27 


.03 


.00 


-.06 
















1 


-.23 


.10 


.20 


















1 


.00 


-.03 




















1 


-.02 



1 



4 1 



autocorrelation statistic should be equal to zero [Bef. 7z 
page flSO]. For the model of choice, this statistic was 
equal to .06 and hence the error terms are considered to be 
independent. 

A total of forty different models were analyzed by the 
**ANOVA'* package. The four covariance models of highest 
interest will be discussed individually. While these four 
models use the fourth quarter qpr as the dependent variable, 
each of the other three qpr's were analyzed as the dependent 
variable also. The results of those analyses were not 
significantly different from the 4th quarter models. 



E. TBE TWO COFACTOB AND SIX MAIN EFFECTS MODEL WITH 
IITSBACTIOHS 



This model used 
cofactors and the 
degree, refresher (y 
main effects. The 
APC1 an d APC2, A PCI 
and refresher (yes 
from the "ANOVA" pro 
The coefficient 
is the highest of a 
Thus this model is a 
fourth quarter OA g 
relatively significa 
time since college, 
. 05 level (. 029) . N’ 
icance. The covaria 
Table XIII is 
provided as an out 
interesting to note 
college is positive. 



time since college and college rating as 
three academic profile codes, college 
es or no) and year graduated from NPS as 
model included the interactions between 
and college degree, and college degree 
or no). Table XII is the ANOVA table 
gram. 

of multiple determination (R2) of .532 
ny of the models analyzed in the study, 
ble to explain 53% of the variability in 
rades by Navy students. The model is 
nt (.0 06) but only the one variable, 
is individually significant above the 
one of the interactions show any signif- 
nce model is shown in Figure 5.4 . 

a listing of the beta coefficients 
put from the "ANOVA" program. It is 
tnat the coefficient for time since 



2 



tnat 



TABLE XII 
ANOfA TABLE 



R-SQUARE = .53 SERIAL AUTOCORRELATION = -.019 



SOURCE OF VARIATION DF 

TOTAL 158 

ERROR 96 

^DDEL 62 

XI TIME SINCE COLLEGE 1 

X2 COLLEGE RATING 1 

FACTOR 1 APCl 4 

FACTOR 2 APC2 3 

FACTOR 3 APC3 5 

FACTOR 4 COL. DEGREE 6 

FACTOR 5 REFRESHER 1 

FACTOR 6 YR GRAD NFS 11 

INTERACTION 1X2 9 

INTERACTION 1X4 16 

INTERACTION 4X5 5 



ss 


MS 


F 


SIG 


17.3 


.109 






8.1 


00 

o 






9.2 


.15 


1.75 


.006 


.41 


.41 


4.88 


.029 


.11 


.11 


1.30 


.257 


.29 


.07 


.86 


.492 


.08 


.03 


.31 


.818 


.34 


.07 


.82 


.539 


.83 


.14 


1.63 


.147 


.07 


.07 


.83 


.366 


.83 


.08 


.89 


.549 


.86 


.10 


1.14 


.345 


1.28 


.08 


.95 


.516 


.38 


.08 


.90 


.485 



Yt = ^6 r Xc/ f Xix •*’ Xj, j -f Xi. 5 

f -t ^7 ^(7 -f Xt, Xti Xc I i- KifXifi 

^ c = L •••W57 



Figure 5.4 Two Cofactor and Six M/E Model with Interactions. 

F. TEE TWO COFACTOe : SIX MAIN EFFECTS MODEL WITHOUT 

INTERACTIONS 

liiis model is the same as the previous section’s model, 
however, the insignificant interactions were not included. 
Table XIV is the ANOVA table from the "aNOVA" program. 

The coefficient of multiple determination (R 2) has 
decreased to .373 but the significance of the model has 
improved a bit to .0004. Now both time since college 
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TABLE XIII 
BETA COEFFICIENTS 



TERM 



BETA COEFFICIENTS 



COVPJIIABLES 

xliii 

CONSTANT: 

MAIN EFFECTS 

FACTOR (1) 
LEVEL(1 
LEVEL(2 
LEVEL 3 
LEVEL(4 
LEVEL(5 
FACTOR (2): 



.025 

.073 

3.642 

APCl 

.203 

-.068 

-.134 

-.142 

.141 

APC2 



Time Since College 
College Rating 



ARC Code 

APCO 

APCl 

APC2 

APC3 

APC4 



LEVEL 1 




.038 


APCO 


LEVEL( 


2 


.054 


APCl 


LEVEL i 


3) 


-.046 


APC2 


LEVEL! 


4) 


-.046 


APC3 


FACTOR (3): 


APC3 




LEVEL< 


'M 


.019 


APCO 


LEUTHlil 


2 


-.010 


APCl 


LE7.T1.( 


13) 


-.060 


APC2 


LEVEL! 


;4 


.045 


APC3 


LEVEL! 


.5) 


-.078 


APC4 


LEUTXi ! 


!6 


.084 


APC5 


FACTOR (4): 


COLLEGE 


DEGREE 


LEVEL(l) 


.509 


B’jsiness 


LEVEL! 


2 


-.029 


Engineering 


LE'7EL(3 


.259 


Humanities 


LEVEL(4 


-.017 


Math 


LEVEL! 


^3 


-.295 


Social Science 


level! 


6 


-.340 


Naval Science 


LEVEL!?) 


.087 


Operations Analy 


FACTOR !E 




REFRESHER 


LEVEL(l): 


-.116 


Refresher Yes 


LE7/EL{2): 


.116 


Refresner No 



FACTOR (6; 



YEAR GRADUATED InPS 



LE77EL(1): -.133 


1974 


LE7/EX> ! 2 ) : -.115 


1975 


LEVEL 3 : -.056 


1976 


level! 4 : .186 


1977 


LE77EL!5 : .284 


1978 


LE7EL!6 : -.088 


1979 


LEVEL 7 : .032 


1980 


LEVEL!8h -.109 


1981 


LEVEL!9): .064 


1982 


LEVEL 10): -.068 


1983 


LEVEL!i1): -.042 


1984 


INTERACTIONS APCl X APC2 INTERACTIONS 


NUMBER (1): 




LEVEL!!): -.089 


1 X 1 


lEVEL 2): .213 


1 X 2 


level! 3 : .032 


1 X 3 


LEVEL!4): .447 


2X1 


LEVEL!5): -.275 


2X2 


LE\TL!6 : .125 


2X3 


LE7/EL 7 : -.073 


3X1 


LEVEl!8): -.341 


3X2 


LE77EL!9): .248 


4 ‘X 1 



TABLE XIII 

BETA COEFFICIENTS (cont’d.) 



NUMBER (2); 



LE\^(1) 

LEVEL(2 


LEVEL I 


‘3 


LEVEL! 




LEVEL! 




LEVEL ! 




LEVEL! 




LEVEL! 


|8 


LEVEL! 


9) 


LEVEL ( 


10 


LEVEL ( 


111 


LEVEL! 


:i2 


LEVEL! 


;i3 


LEVEL ! 


Il4 


LEVEL 




LEVEL! 


16 



NUMBER (3); 



LEVEL ! 




1 : 


LD/EL! 


12 


1 : 


LEVEL ! 


| 3 ! 


I: 


LEVEL! 




1 : 


LEVEL! 


5 


1 : 



-1.332 


1 


X 


1 


-.660 


1 


X 


2 


-.688 


1 


X 


3 


-.043 


1 


X 


4 


.472 


1 


X 


5 


-.114 


1 


X 


6 


.013 


2 


X 


1 


.377 


2 


X 


3 


.422 


2 


X 


4 


.067 


2 


X 


5 


-.155 


3 


X 


2 


-.085 


3 


X 


3 


.156 


3 


X 


6 


.113 


4 


X 


1 


.311 


4 


X 


4 


.340 


4 


X 


5 


4X5 


INTERACTION 


.192 


1 


X 


1 


.134 


2 


X 


1 


-.591 


3 


X 


1 


.046 


4 


X 


1 


.025 


5 


X 


1 



(signif icance of .03) and ARC 1 (significance of . 005) are 
seen to be very significant factors. This version of the 
covariance model is simple with fewer terms and is suown in 
Figure 5-5 . 

Table XV is a listing of the beta coefficients provided 
as an output from the "ANOVA” program. The levels of the 
APC 1 variable are seen to contribute positively at the first 
two levels and negatively at the lower three levels as one 
would Icgicaily expect- The APC2 variable also "behaves" in 
a similar fashion from level one through level four- 
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TABLE Z17 
AHOfA TABLE 



R-SQUARE = .37 SERIAL AOTOCORRELATIC^I = .017 



SOURCE OF VARIATION DF 

TOTAL 158 

ERROR 126 

^DDEL ^ 32 

XI TIME SINCE COLLEGE 1 

X2 COLLEGE RATING 1 

FACTOR 1 APCl 4 

FACTOR 2 APC2 3 

FACTOR 3 APC3 5 

FACTOR 4 OOL. DEGREE 6 

FACTOR 5 REFRESHER 1 

FACTOR 6 YR GRAD NFS 11 



ss 


MS 


F 


SIG 


17.3 


.109 






10.9 


.09 






6.4 


.20 


2.34 


.0004 


.41 


.41 


4.79 


.030 


.12 


.12 


1.43 


.234 


1.33 


.33 


3.86 


.005 


.22 


.07 


.84 


.475 


.35 


.07 


.81 


.547 


.92 


.15 


1.79 


.106 


.00 


.00 


.01 


.974 


.59 


. 53 


.62 


.801 



Yi. = 

f i‘ ^’7 7 /■ £ c 



Figure 5.5 Two C/F and Six H/B Model without Interactions. 

G. THE FOOE COFACTOB AND THEBE MAIN EFFECTS MODEL KITH 
liTEBACTIONS 

The next model uses the variables time since college, 
college rating, year graduated from NFS and length of 
refresher as cofactors. It includes APCl, college degree 
and designator as main effects. The model also evaluates 
the interaction between APCl and college degree. This 
covariance uiodei has a coefficient of multiple determination 
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TABLE 17 

BETA COEFFICIENTS 



TEIJM 



BETA COEFFICIENTS 



COVARIABLES 
X(1 
X(2 
CONSTANT: 

MAIN EFFECTS 

FACTOR (1): 
LEVEL( 1 
LETVELi 2 
LEVEL 3 
LEVEL(4 
LEVEL(5) 
FACTOR (2): 
LEVEL(l) 
LEVEL(2 
LEVEL 3 
LEVEL(4 
FACTOR (3) 
LEVELd 
LEVTL 2 
LEVEL 3 

levelU 

LEVEL(5 

r .EVFT.f 6 
FACTOR (4) 
LEVEL(1 
LEVEL(2 
LEVEL 3 
LEVEL{4, 
LEVEL 5 
LEVEL(6] 
LETVEXi 
FACTOR (5): 
LEVEL(l) 
LEVEL(2) 
FACTOR (6): 



.026 

.064 

3.371 

APCl 
.352 
.149 
-.007 
-.070 
-.424 
APC2 
.055 
.054 
-.032 
-.077 
APC3 
.066 
.026 
-.072 
.007 
-.095 
,068 



Time Since College 
College Rating 



ARC Code 

APCO 

APCl 

APC2 

APC3 

APC4 

APCO 

APCl 

APC2 

APC3 

APCO 
APCl 
APC2 
APC3 
APC4 
APC5 



COLLEGE DEGREE 
.148 Business 

.079 Engineering 

-.166 Humanities 

. 022 Math 

-.099 Social Science 

-.128 Naval Science 

.144 Ooerations Analysis 

REFRESHER YES OR NO 
-.001 Refresher Yes 

.001 Refresher No 

YEAR GRADUATED NPS 



LEVELU ) 


-.075 


1974 


LEVEL! 2 ) 


-.151 


1975 


LETVEIj ( 3 ) 


.074 


1976 


LEVEL 4) 


.105 


1977 


LEVEL 5 


-.048 


1978 


LEVEL ( 6 ) 


.015 


1979 


LEVELU 


.134 


1980 


LEVEL 8) 


-.040 


1981 


LEVEL 9) 


.006 


1982 


level! 10 ! 


1: -.055 


1983 


LEVEL 11 


1: .011 


1984 


level!i2; 


1: .024 


1985 



of .466 wQile the significance of the model is .000026 
significant variables were time since college (.026), 
(.008 ), college degree (. 027) and designator (. 004). 
XVI is the ANOVA table from the "ANOVA" 
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The 
A?C 1 
Table 



program 





TABLE 


I?I 










ANOfA 


TABLE 








R-SQUAPE = .47 


SERIAL AUTOCORRELATION = -.004 




SOURCE OF VARIATION 


DF 


SS 


MS 


F 


SIG 


TOTAL 


158 


17.3 


.109 






ERROR 


119 


9.3 


00 

o 






^»DEL 


39 


8.1 


.21 


2.66 


.00003 


XI TIME SINCE COLLEGE 


1 


.39 


.39 


5.07 


.026 


X2 COLLEGE RATING 


1 


.15 


.15 


1.90 


.171 


X3 YR GRAD NPS 


1 


.03 


.03 


.37 


.545 


X4 LENGTH OF REFRESHER 


1 


.07 


.07 


.87 


.355 


FACTOR 1 APCI 


4 


1.13 


.28 


3.65 


.008 


FACTOR 2 COLLEGE DEGREE 


6 


1.16 


.19 


2.48 


.027 


FACTOR 3 DESIGNATOR 


8 


1.88 


.23 


3.02 


.004 


INTERACTION 1X2 


17 


1.01 


.06 


.77 


.730 


Cnee again the 


interaction term 


does not 


appear 


to be 


significant- The 


particular 


covariance model 


is shown in 



Figure 5.6 . 



^ f X^' f -f P '2 X<:2 ^ Xt i? Xc y -&^sXi r 

T^^fXcs tPf Xci^cz t 



rigore 5.6 4 Cofactor and 3 M/E Model with Interactions. 

Table XVII is a listing of the ceta coefficients from 
the *'ANCVA" program. It can be seen that the variable 
length of refresher contributes negatively to tne overall 
performance average. The APC1 variable performs logically 
in decreasing order from the 0 code to the lower APCI code 
of 4 . 
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TABLE XTII 
BETA COEFFICIENTS 



TEIIM 



CDVARIABLES 
X(1 
X(2 
X 3 
X(4 
CONSTANT: 

MAIN EFFECTS 

FACTOR (1): 
LEVEL(l) 
LEVEL(2 
LEVEL 3 
LEVEL 4 
LEVEL(5 
FACTOR (2): 
LEVEL(1' 
LEVEL 2 
LEVEL(3 
LEVEL(4 
LEVEL(5 
LEVEL(6 
LEVEL(7 
FACTOR (3): 
LEVEL(l) 
LEVEL(2' 
LEVEL(3 
LEVEL(4 
LEVEL 5 
LEVEL(6 
LEVEL(7 
LEVEL(8 
LEVELO 
INTERACTIONS 

NUMBER (1) 
LEVEL ( 1 
LEjEL 2 
LEvEL(3 
LEVEL(4 
LE/EL(5 
LEVEL{6 
LEVEL 7 
LE7EL(8 
LEVELO 
LEVEL 10 
LEVEL 11 
LEVEL 12 
LEVEL(13 
LE/EL(14 
LEVEL 15 
LEVEL(16 
LEVEL(17 



BETA COEFFICIENTS 



.022 Tirre Since College 

.076 College Rating 

.005 Year Graduated NFS 

-.035 Length of Refresher 

3.231 

APCl APC Code 

.798 APCO 

.262 APCl 

.024 APC2 

-.063 APC3 

-1.021 APC4 

COLLEGE DEGREE 
.376 Business 

.138 Engineering 

-.194 Humanities 

.016 Math 

-.246 Social Science 

-.251 Naval Science 

.161 Operations Analysis 

DESIGNATOR 
-.177 1100 

-.041 1110 

.217 1120 

.117 1310 

.117 1320 

.082 1400 

.056 1610 

.183 3100 

-.554 1130 

APCl X APC2 INTERACTION 



-.926 


1 


X 


1 


-.422 


1 


X 


2 


-.385 


1 


X 


3 


.076 


1 


X 


4 


-.437 


1 


X 


5 


-.148 


1 


X 


6 


.014 


2 


X 


1 


2.146 


2 


X 


3 


.300 


2 


X 


4 


-.152 


2 


X 


5 


-.350 


3 


X 


1 


-.030 


3 


X 


2 


.020 


3 


X 


3 


.122 


3 


X 


6 


.148 


4 


X 


1 


.310 


4 


X 


4 


.334 


4 


X 


5 



H. STDDI HODEL :THfiEE HAIN EFFECTS :FOOR COFACTORS :NO 
INTERACTIONS 



between the variables APCl and college 
and the resulting model is tne one 
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The interaction 
degree was removed 



selected as the study model. once again the four cofactors 
are time since college, college rating, year graduated from 
NPS and length of refresher. Ihe main effects are the first 
academic profile code (APCl) , college degree and designator. 
The model is seen in Figure 5- 7 . 



Figure 5.7 4 Cofactor and 3 R/E Rodel vithout Interactions. 

Table XVIII is the ANOVA table from the "ANOVA" program. 
The ccefficient of multiple determination is -408 and the 
model nas an extremely high significance of .00000007. This 
model shows the significance of time since college (.015), 
APCl (.00002) , college degree (.032) and designator (.004) 
to all be important factors in explaining the variability in 
fourth quarter gpr's of students in the OA curriculum, 

Tabxe XIX is a listing of the beta coefficients from the 
"ANOVA'* program. The cofactors time since college, college 
rating and year graduated from NPS have a positive contribu- 
tion to the fourth quarter qpr while length of refresher 
contributes negatively. APCl nenaves in a very logical 
fashion. The better one's college performance reflects a 
more positive contribution to the dependent variable (fourth 
quarter qpr). This same variable contributes in a negative 
manner as the college qpr decreases to the lower two levels. 
The college majors of business, engineering, math and opera- 
tions analysis all have a positive beta coefficient while 
the social science, humanities and naval science majors have 




i-ei 
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TABLE ZVIIl 
AHOfA TABLE 



R-SQUARE = .41 SERIAL AUTOCORREIATION = .057 



SOURCE OF VARIATION 


DF 


SS 


MS 


F 


SIG 


TOTAL 


158 


17.3 


.110 






ERROR 


136 


10.3 


• 

O 

CD 






MODEL 


22 


7.1 


.32 


4.25 


.00000007 


XI TIME ‘'SINCE COLLEGE 


1 


.46 


.46 


6.13 


.015 


X2 COLLEGE RATING 


1 


.20 


.20 


2.71 


.102 


X3 YR GRAD NFS 


1 


.02 


.02 


.30 


.583 


X4 LENGTH OF REFRESHER 


1 


.08 


.08 


1.09 


.298 


FACTOR 1 APCl 


4 


2.24 


.56 


7.43 


.000 


FACTOR 2 COLLEGE DEGREE 


6 


1.08 


.18 


2.39 


.031 


FACTOR 3 DESIGNATOR 


8 


1.79 


.22 


2.96 


.004 


egative coefficients. 


In 


this 


model. 


all 


designators 



except for 1100,1110 and 1130 have a positive beta coeffi- 
cient, Although this model did not have the highest coeffi- 
cient of multiple determination, it is a straign tfor ward , 
significant model. 



TABLE XIX 
BETA COEFEICIENTS 



TERM 


BETA COEFFICIENTS 


COVARIABLES 






X(l): 


.023 


Time since college 


X(2 : 


.083 


Colleae Rating 


X(3 : 


.004 


Year Graduated NFS 


X(4): 


-.037 


Length of Refresher 


CONSTANT: 


3.265 




MAIN EFFECTS 






FACTOR (1): 


APCl 




LEVEL(l) 


.351 


APCO 


LEVEL 2 


.195 


APCl 


LEVEL(3) 


.001 


APC2 


LEVEL(4 


-.114 


APC3 


LEVEL(5) 


-.433 


APC4 


FACTOR (2): 


COLLEGE 


DEGREE 


LEVEL(l) 


.061 


Business 


LELEL(2) 


.138 


Engineering 


LEVEL(3 


-.175 


Humanities 


LE\TI.(4 


.033 


teth 


LEVnj( 5 ) 


-.097 


Social Science 


LEVEL(6 


-.101 


Naval Science 


LEVEL(7) 


.141 


Operations Analv'sis 


FACTOR (3): 


DESIGNATOR 


LEVEL(l) 


-.091 


1100 


LEVEL(2 


-.045 


1110 


LEVEL(3) 


.218 


1120 


LEVEL(4 


.100 


1310 


LEVEL(5 


.117 


1320 


LEVEL(6) 


.072 


1400 


LELTL 7 


.030 


1610 


LE77EL(8) 


.148 


3100 


LE77EL(9) 


-.549 


1130 
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VI. COMC I OSIONS AND BECOMMENDAT IOHS 



A. CCNCI05IONS 

The study shows some interesting insights into evalu- 
ating future performance in regards to the Operations 
Analysis curriculum. It would initially seem quite logical 
to assume that the longer an individual has teen out of 
college the harder it would te for him or her to return and 
succeed in the academic environment. However, this does not 
appear to be the case as reflected by this study. In 
searching for an explanation, motivation could play a major 
cole. Ihose students who start a curriculum middle to late 
in their military service, have most likely decided to make 
the service a career. They are likely to realize how impor- 
tant successful completion of their chosen subspecialty is 
to their remaining time in the service and are consequently 
willing and ready to make whatever effort is required to 
accomplish that goal. More correctly, they are out to do 
the best they can possibly do while earning their degree. 
This grouping would also imply that they are most probably 
of an age to have their families and a maturity to be able 
to concentrate their efforts toward a long term goal. 

In almost every model tested, the variable for college 
academic performance (APC1) was seen to be a significant 
factor- Surprisingly, the math (APC2) and technical code 
(APC3) did not prove to be very meaningful in the manner of 
explaining the variability of student performance. Given a 
choice it appears to be more logical to select a student 
based on his performance in his chosen field rather than to 
strictly choose based on his undergraduate degree. 
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The negative contribution or length of refresher prob- 
ably means those individuals who need it most are in fact 
getting the extra quarter or two. This is possibly 
confounded by the ability to get an extra quarter or two 
"after the fact", in that, early poor performance can "flag" 
a student and draw attention to him. With liasion between 
the curricular officer and the student’s detailor, an addi- 
tional quarter or two can get added to his tour at N?S. 

With the possible exception of business majors, there 
are nc surprises in the college degree variable. Those 
students with college majors of math, engineering, opera- 
tions analysis and business in fact nave performed as an 
average better than the humanities and social science 
ma j ors. 

The designator variable was in fact significant to the 
model and showed the designators 1100, 1110 and 1130 to have 

a negative contribution toward fourth quarter academic 
perf orraance. 

The study population covered only those students who 
successfully completed the OA curriculum. Of course one 
would want to infer that the insights gained from the study 
group would apply to the target group of future OA students. 
This can not be done in the strict predictive sense but the 
study can suggest that any selection of future OA students 
be influenced by these results. 

The model preferred by the author is discussed in 
section H of Chapter V. This model has an R 2 value of .41 
while another model investigated (section E of Chapter V) 
attains an R2 of .53. The model of section H has a much 
higher level of significance and is a simpler less complex 
model . 
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B. BECOflHENDATlOHS 



A very interesting study to complement this one would be 
to investigate those Navy students who started but did not 
complete the OA curriculum during the last ten years. The 
study group would not be very large but it could possibly 
provide additional insight into the problem. 

Recent interest has been generated to have all NPS 
students take the Graduate Record Examination (GRE) . 
Currently, this predictor is available for very few individ- 
uals in this study. Exactly when the test will be taken is 
still to be determined but a study combining academic 
profile codes and the GEE could prove to he much more 
successful in developing a predictive model. In this 
regard, the recommendation that the APC's and GRE scores be 
maintained by NPS as a permanent part of the student's tran- 
script is a necessity for future studies of this type. 

Another study of interest would be to determine the 
validity and usefulness of the newly established Technical 
Transition Program. This new program will require a few 
years before the data can be collected studied but adequate 
records must be maintained in order to evaluate it in the 
future. 
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appendix a 



ACRONYMS AND ABBREVIATIONS 

APC Academic Profile Code 

APCl Academic Profile Code 1st Digit 

APC2 Academic Profile Code 2nd Digit 

APC3 Academic Profile Code 3rd Digit 

ARE Academic Record Evaluation 

GRE ’^Graduate Record Examination 

NMPC Naval Military Personnel Command 

NPS Naval Postgraduate School 

OA Operations Analysis 

QPR Quality Point Rating 

r Pearson's Product Moment Correlation Coefficient 

R^ Coefficient of Multiple Determination 

TTP Technical Transition Program 



APPENDIX B 



ACADEMIC RECORD EVALUATION 

NPS 5040/2 (12-81) 



Year Group 
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1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 



APPENDIX C 
THE STUDY DATA 



Index 

APCl 

APC2 

APC3 

4t± QIR QPR 

6th QTR QRAD QER 

8th Om Total GRAD QPR 

8th QTR Total QPR 

College Rating — Main Effect 

College Degree 

3 = Business 

6 = Engineering 

7 = Huiranities 

8 = Math 

9 = Social Science 

10 = Naval Science 

11 = OA 

Designator 



2 = lllX 

3 = 112X 

4 = 131X 

5 = 132X 

6 = 140X 

7 = 161X 

8 = 310X 

9 = 113X 

Tine since college (in months) 
Refresher (1 = yes, 2 = no) 
College Rating (cofactor) 

Year graduated from NPS 
A selection value 
Length of Refresher (in quarters) 
Time since college (main effect) 
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figure D. 1 6th Qtr Grad QPH vs APC1. 
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Figure D. 2 8th Qtr Grad QPfi vs APC1. 
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Figure D.3 8th Qtr Total QPE vs APC1, 
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Figure D. 4 6th Qtr Grad QPB ts APC2. 
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Figure D. 5 8th Qtr Grad QPfi vs APC2. 
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Figure D.6 8th Qtr Total QPB vs APC2. 
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Figure D. 7 6th Qtr Grad QPfi ts APC3 
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Figure D. 8 8th Qtr Grad QPR vs APC3» 
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Figure D.9 8th Qtr Total QPE vs APC3- 
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figure D- 10 6th Qtr Grad QPfi ts College Degree. 
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Figure D-11 8th Qtr Grad QPB ts College Degree. 
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Figure D. 12 8th Qtr Total QPE vs College Degree- 
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Figure D. 13 6th Qtr Grad QPfi vs Designator- 
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Figure 0. 14 8th Qtr Grad QPR vs Designator. 
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Figure D. 15 8th Qtr Total QPB vs Designator. 
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Figure D. 16 6th Qtr Grad QPR vs Length of Refresher. 
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Figure D.17 8tb Qtr Gcad QPfi ws Length of Befresher. 
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Figure D.18 8th Qtr Total QPR rs Length of Refresher. 
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Figure D. 19 . 6tli Qtc Grad QPB vs College Bating. 
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Figure D.20 8th Qtr Grad QPB vs College Bating. 
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Figure D-21 8th Qtr Total QPB vs College Rating- 
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Figure 0.22 6th Qtr Grad QPB vs Year Graduated NPS. 
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Figure D.23 8th Qtr Grad QPB ts Ifear Graduated NPS. 
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Figure D-24 8th Qtr Total QPR vs lear Graduated MPS. 
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Figure D.25 6th Qtr Grad QPE ?s Time Since College- 
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Figure D.26 8th Qtr Grad QPR rs Time Since College. 
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Figure D.27 8th Qtr Total QPB vs Time Since College. 
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APPENDIX E 



Weloome to the Anova package. 

This package was developed by Prof. Russell Richards at NPS. The 
latest revision occurred on May 21, 1985. Please provide your canments 
to Prof. Richards in Root 271. 

Type DESQIIBE for basic documentation. Other instructions are 
obtained ‘by typing : 

EXIRACTfKW (explains the use of the function extract) 
GLOBAL (lists the global variables in the workspace) 
SYNTAX (shows the syntax for use of several functions) 

In addition, the function called, AOVUTY, provides a menu of 
options which should be somewhat self-explanatory. 

This paclcage is still under develcpment. 

To use the general linear model package for analysis of variance, 
you must first enter your data in the form required. Your need an N X 
1 array, Y, containing the observed values of the dependent variables, 
an N X NCDV array, COV. containing the values of the NODV covariables 
(NCOV may be 0), and an N X NF array, data containing the subscripts of 
the NF factors to be considered in the analysis. Note: The columns of 
data contain subscripts which must hDe integers 1 , 2 , . . . , M where M is 
the number of levels of a factor. You can execute the functicn called 
RECODE to rewrite the values in data so that they satisfy this 
requirement (simply type RECODE). The function named EXTRACT may be 
useful for creating these arrays if the data can be extracted from a 
larger array which contains the necessary data. Type EXTRACTHCW for 
info on the use of extract. If you want to enter the data at the 
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terminal, you can use the function called INPUT. 

After the necessary data are entered into the workspace, 
type RUN 0 to begin the analysis (the argument 0 indicates the initial 
run with the given data; for subsequent runs using the same data, enter 
RUN 1). For the first run with a given set of data you will be 
prompted to enter various infomiaticn needed by the program. This 
information includes names for the factors, oovariables, and for the 
job. It also asks if you want to transform the data. If so, the 
original values of the dependent variable are stored in the array OIDY 
and a new Y array is created. 

With the initialization conpleted, you will be asked to enter the 
interactions desired to be included in the analysis (if any). You 
should enter the interactions by typing a vector containing the numbers 
of the factors which ccmprise the interactions. For example, if you 
want to include interactions between factors 1 and 2; factors 1 and 3; 
and factors 1, 2, and 3 you should enter the vector 12 13 123. 

The program then performs the following tasks; 

1 . A matrix D having N rows and a number of columns which depends 
the number of levels of each of the NF factors is generated. This is 

the porticn of the design matrix corresponding to the main effects. It 
contains only the values 0, 2, and -1. The min effects are 
autoTBtically normalized so that the min effects sum to 0. A 
bookkeeping array, DF, of size NF X 2 is also generated. The elements 
of the ith rcw of BF indicate which cols of D correspond to the ith 
factor . 

2. An array, DD containing N rows is generated. The number of 



cols of DD depends on the nuntier of interactions and the number of 
levels of each interaction. DD is that portion of the overall design 
matrix which corresponds to the interaction terms. Like D, DD contains 
only the values 0, 1, and -1. A scalar, NI, indicating the number of 
interactions is created, and a bookkeeping array, Bl of size NI X 2 is 
generated. It indicates which cols of DD correspond to v^ich 
interactions. 

3. The overall design matrix X, is generated by catenating CCV, 

D, and DD. 

4. The design matrix is checked to see if it is nonsingular. If 
not nonsingular, the rank is determined and a set of cols that can be 
eliminated is indicated. If the design natrix can be made nonsingular 

by elimination of one or more cols from the interaction set, that is 
done automatically. If not, program execution terminates. 

5. The analysis of variance is performed on the model, Y = XBETA. 
Output consists of the R-squared statistic, the ANOVA table with the 
covariable effects. The main effects and the interaction effects all 
indicated. For each effect, the degrees of freedan, the sum of 

squares, the rrean square, and an F ratio are presented. The error and 
total sums of squares and degrees of freedom are also given. Finally, 
surmary statistics for each of the covariables and for the dependent 
variable for each level of each of the main effects are provided. This 
informaticn consists of the observation counts. The mean, the 
variance, and the standard deviation. The suitmary statistics are given 
for the original data, not the transformed data. 

6. Available at the conclusion of the run is a GLOBAL vector called 
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BETTA which contains the estimates of the parameters included in the 
full model . 

7. After the analysis of variance is performed, various utility 
functions can be performed on the output by executing the function, AOVUTY. 
That function presents a menu of your choices. The function called EXTRfCT 
can be used to create the input arrays required by the ANOVA package. 

It should be used v^en you already have an array from which all of the 
required data can be extracted. The syntax of the function is; 

EXTRACT DATA 

Where data is a two-dimensional array. 

The EXTRACT functicn will prompt the user for the information it 
requires. The user rtust knew which columns of data correspond to the 
data that he wants to extract. 

One of the questions asked is the column of the selection variable. 

It is assumed that the user wants to select only specific rows of data 
corresponding to values of a selection variable. For example, suppose the 
third column of data contains 1 or 2 with 1 representing males and 2 fatales. 
If the analysis is to be performed on imles only we select those 
observations with a 1 in column 3 . 

The values of the variables in the columns that are used to refer to 
factors must be integers 1, 2, 3, ... etc. that will be used by this 
package as subscripts ( factor level indicators ) . 

After using EXTRACT to create the input data arrays, the user can then 
perform the analysis of variance by typing RUN 0. 

The syntax of the major fmetions in the ANOVA package are: 

EXTRACT ARRAY (Extracts the required data from array) 
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RECODE 



(Operates on the GLOBAL array data) 

INPUT (Creates the arrays needed for run) 

RUN K (K is 0, 1, or 2) 

AOVUTY GLOBAL (Consists of various useful utility functiois) 

This provides a description of the GLOBAL variables used by the ANOVA 
package. The convention used in naming GLOBALvariables is to always 
use underscored names for GLOBAL variables. 

Y - The vector of values of the dependent variable. 

N - The number of observations in Y. 

NCOV - The number of covariables to be considered. 

COV - The array of size N by NCOV containing the values of the NF. 

NF - The number of factors to be considered. 

DATA - The array of size N by NF containing the subscripts of the 
NF factors for each of the N observations. 

D - The design matrix containing N rows of the values 0, 1, and 
-1 corresponding to the main effects to be considered in the model. 

The number of cols of D depends on the number of levels of the NF factors. 
A factor having K levels will have K-1 cols in D. K-1 dunmy variables will 
be defined with values 0 or 1. The Kth level is defined so that the sum 
of the effects is zero. 

BG - This is an array of size NF by 2 containing boolckeeping info 
concerning which factors correspond to which columns of D. 

DD - This is an array of N rows containing the portion of the overall 
design matrix corresponding to the interactions to be considered. 

It consists entirely of the values 0, 1, and -1. The number of cols of DD 
depends on the factors and interactions considered. 
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